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ABSTRACT 



This study consists of a factor analysis of the behav- 
ioral dimensions of the current Marine Corps Performance 
Evaluation System, using randomly selected fitness reports 
for officers in the grades Second Lieutenant through Colonel. 
The objectives and uses of performance evaluation, both in 
the Marine Corps and in general, are discussed and the factor 
analysis methodology is developed. The fitness report data 
is then analyzed, leading to an identification of three 
underlying factors common to all behavioral dimensions. The 
nature and composition of these factors is then discussed. 
Finally, it is concluded that the Marine Corps Fitness 
Report could be effectively simplified by using the three 
common factors rather than the 22 dimensions in current 
use . 
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I. 



INTRODUCTION 



The purpose of this thesis is to conduct an analytic 
study of the Marine Corps 1 Performance Evaluation System to 
determine whether or not the system, as currently implemented, 
measures clearly, concisely, and unambiguously that which it 
is designed to measure. The study employs a statistical 
technique called factor analysis and relies on data supplied 
by Headquarters, United States Marine Corps (Code MMPA) , 
Washington, D. C. 

Performance evaluation in general, and the Marine Corps 
system in particular, are discussed. The factor analysis 
technique is developed, not rigorously, but in sufficient 
detail to allow readers to understand the meaning and sig- 
nificance of the results. 

The data is then analyzed, showing the statistical 
correlations between the dimensions of the evaluation, lead- 
ing to a demonstration of how the system could be streamlined 
by utilizing the few underlying factors rather than the many 
dimensions . 
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II. PERFORMANCE EVALUATION 



A. GENERAL 

The success or failure of any organization, large or 
small, complex or simple, military or civilian, is tied 
directly and inextricably to the performance of its personnel. 
This is not to say that other factors do not exist, or even 
that they are insignificant, but ultimately it is people-- 
human beings — who make the organization succeed or fail. It 
is people who run the machines, program the computers, and 
make the important decisions. And it is people who determine 
the objectives of the organization, set its standards of per- 
formance and evaluate its personnel on the basis of those 
standards . 

The key to this important determinant of organizational 
output is an effective and efficient personnel performance 
evaluation system. It is such a system which will, in the 
long run, determine the "quality" of the organizational actors 
and thus of the organization, for it determines who will rise 
to positions of leadership and authority, and who will be de- 
moted--or even fired. "Quality" is used here in a relative 
sense, meaning "degree of excellence when compared to the or- 
ganizational standards." More specifically, the system 
(ideally) measures the actual and potential contributions 
of the individual to the success of the organization. 
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All organizations use some type of performance evaluation 
system. People are always judging the performance of others — 
peers, subordinates, superiors. The system may be either for- 
mal or informal and its essential elements will vary widely, 
depending on the objectives, size, complexity and general 
structure of the organization itself. Each organization in- 
ternally defines its own objectives, its own standards, and 
must, therefore, determine its own evaluation technique. By 
far the most common rating technique and the one used by the 
Marine Corps is the subjective rating scale in which several 
dimensions of an individual's performance are measured against 
a standard (below average, average, above average, etc.). 

The advantages of this technique are that it is clear and easy 
to use, but it is also subject to rater biases, leniency, 
central tendency, and the halo effect (having the rating on 
one dimension affect all others either positively or nega- 
tively) . 

Regardless of the technique used, however, the objectives 
of the performance evaluation system are generally the same. 
According to E. F. Huse (5), these objectives are: 

1. Meeting organizational objectives and improving per- 
formance--the subordinate needs to know what his objectives 
are and to obtain feedback about his performance and areas 
for imp r o veme n t ; 

2. Proper salary administration--the manager needs to 
review the performance of his subordinates in order to recom- 
mend proper salary action; 
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3. Collecting and storing data for future administrative 
actions on promotions, transfers, and demotions or discharges; 

4. Identifying training needs — the organization needs to 
maintain accurate, current information about the strengths 
and weaknesses of its employees in order to develop timely 
and appropriate training programs; 

5. Improving the selection of new employees — if an organi- 
zation is to have a systematized, valid selection system, it 
needs proper criteria against which to validate its selection 
instruments . 

A different technique or appraisal approach may be required 
for each of these objectives, but more often than not, organi- 
zations attempt to use an all-purpose form such as the sub- 
jective rating scale mentioned above to simultaneously satisfy 
all of them. This is not to imply a criticism of either the 
all-purpose approach or the organization opting to use it. 

The all-purpose form may satisfy the objectives of the organi- 
zation to such an extent that the additional complexity of 
multiple-forms is not justified, or it may simply be an 
economic necessity. 

B. PERFORMANCE EVALUATION IN THE MARINE CORPS 

The objective of the Marine Corps performance evaluation 
system, as stated by Marine Corps Orders of the 1610.7-series 
is to provide, for all officers and noncommissioned officers, 
a fitness report which is an evaluation of duties performed and 
the manner in which performed. Such reports represent a com- 
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prehensive portrayal of the professional qualifications, 
personal traits and characteristics, and potential of the 
individual. The order further states that fitness reports are 
the principal record of a Marine's performance and conduct and 
as such are vital in determining duty assignments and in sel- 
ection for promotion. The system, as thus described by the 
order, embraces three of Huse 1 s five objectives, omitting the 
objectives of providing records for training and selection of 
new employees. The requirements for such records obviously 
exists within the Marine Corps, but they are satisfied by 
other means. The principal instrument of the Marine Corps 
system is a single, all-purpose subjective rating form, an 
example of which is contained in Appendix A. The form pro- 
vides for the measurement of 21 dimensions of performance on 
a rating scale from unsatisfactory to outstanding. There is 
also a provision for a rating of "Not Observed" in case a 
particular performance dimension is not demonstrated during 
the period of the report. 

The Marine Corps Order defines 14 of the 21 performance 
dimensions. They are: 

1. Endurance: Physical and mental ability to carry on 

under fatiguing conditions. 

2. Personal Appearance: The trait of habitually appear- 

ing neat, smart, and well-groomed in uniform or in civilian 
attire. 

3. Military Presence: The quality of maintaining appro- 

priate dignity and soldierly bearing. 
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4. Attention to Duty: Industry, the trait of working 

thoroughly and conscientiously. 

5. Cooperation: The faculty of working in harmony with 

others, both military and civilian. 

6. Initiative: The trait of taking necessary or appro- 

priate action on own responsibility. 

7. Judgment: The ability to think clearly and arrive 

at logical conclusions. 

8. Presence of Mind: The ability to think and act promptly 

and effectively in an unexpected emergency or under great 
strain . 

9. Force: The faculty of carrying out with energy and 

resolution that which is believed to be reasonable, right 
or duty. 

10. Leadership: The capacity to direct, control, and 

influence others and still maintain high morale. 

11. Loyalty: The quality of rendering faithful and willing 

service, and unswerving allegiance under any and all circum- 
stances . 

12. Personal Relations: Faculty for establishing and main- 

taining cordial relations with both military and civilian 
associates . 

13. Economy in Management: Effective utilization of men, 

money, and materials. 

14. Growth potential: The capacity for professional devel- 

opment . 

The remaining 7 oL the 21 dimensions are undefined and left 
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to the interpretation of the rater. Implicit in this omission 
is the assumption that they are self-explanatory, an assump- 
tion which may or may not be justified. These undefined 
dimensions are: 

1. Regular duties 

2. Additional deities 

3. Administrative duties 

4. Handling officers 

5. Handling Enlisted Personnel 

6 . Training Personnel 

7. Tactical Handling of Troops 

The report provides for the appraisal of a final dimen- 
sion, entitled "General Value to the Service". This item is 
the last evaluation on the fitness report and there is a temp- 
tation, consciously or otherwise, for the raters to treat it 
as a composite or average of the previous 21 marks. The 
Marine Corps Order , however, clearly and specifically advises 
against this, stating that it should be an estimate of how the 
Marine compares with all other Marines of the same grade (rank) 
known to the rater, taking into consideration all important 
factors. It is thus intended to be a separate and unique 
mark, not a composite. 

All dimensions except the last (General Value to the 
Service) are rated on a six-point scale from unsatisfactory 
to outstanding. The scale values, with definitions from the 
order, are as follows: 
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1. Outstanding: one of the clearly superior individuals 

of his grade known to the reporting officer (rater) . 

2. Excellent: qualified to a degree seldom achieved by 

others of his grade. 

3. Above Average: highly qualified. 

4. Average: qualified to a generally accepted standard. 

5. Below Average: below the generally accepted standard. 

6. Unsatisfactory: unacceptable performance. 

The final dimension is rated on a ten-point scale, using 
the six scale values defined above plus intermediate values 
among the top five, i.e., between below average and average, 
between average and above average , etc . . 

A careful examination of the definitions of the dimen- 
sions of the Marine Corps fitness report reveals a potential 
for overlap or confusion among them. For example, the defini- 
tion of initiative implies a certain amount of judgment, since 
it specifies "appropriate action". Similarly, it is difficult 
to imagine good personal relations in the absence of a positive 
spirit of cooperation. To the developers of the form, each 
dimension undoubtedly applies to a separate and distinct aspect 
of performance, but what about to the users? Are they able 
to make the subtle distinctions or are they, in fact, evaluating 
a smaller number of dimensions by basing their evaluations of 
several dimensions on a single characteristic as they see or 
are mentally able to define it. If overlap actually does exist, 
the question arises as to whether or not the number of dimen- 
sions could be reduced to the point where users are able to 
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clearly distinguish among them. Simplicity is certainly a 
worthy objective of any rating system, and if the form could 
be simplified to a smaller number of dimensions which the 
users see as distinct and unambiguous, while still providing 
an adequate evaluation of the relevant dimensions of perfor- 
mance, then such a step would necessarily be an improvement. 

To test the hypothesis that simplification is possible, 
that the essential characteristics of individual performance 
could, in fact, be evaluated by using a smaller number of 
dimensions, a large body of summary fitness report data was 
subjected to an analytic technique called factor analysis. 



III. FACTOR ANALYSIS 



This chapter presents background information concerning 
factor analysis and discusses the methodology used in this 
study. Factor analysis is a statistical technique formulated 
by psychologists at the turn of this century to provide 
mathematical models for the development of psychological 
theories of human ability and behavior. Because of its 
origin and extensive use in psychology, it is often regarded 
as psychological theory, but it has been adapted for use in 
other areas where numerous interacting measurements are ob- 
tained. Its use has greatly expanded as a consequence of 
the development of high-speed electronic computers. 

Since the objective of this study is to subject a set 
of Marine Corps fitness report data to factor analysis, 
rather than to either develop or illustrate factor analysis 
itself, the technique will not be described in great detail. 
What will be presented is just enough for the reader to be 
able to follow and understand the origin and nature of the 
answers and conclusions which result. For a more thorough 
discussion of the technique, the reader is directed to any 
of the references listed in the bibliography, especially the 
one by H. H. Harmon. 

It should also be noted at this point that a Biomedical 
(BIMED) computer program (BMD08M) was used in this analysis, 
so the computational details are not required to either 
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achieve or understand the results. A general understanding 
of the technique is, however, essential. 

A. OBJECTIVES OF FACTOR ANALYSIS 

The primary objective of factor analysis is to obtain 
a parsimonious description of observed data. Harmon (4) sees 
it as a technique to resolve a set of variables into a small 
number of elements, called factors. Resolution is accom- 
plished by the analysis of the correlations between the var- 
iables. Factor analysis, then, is essentially a linear re- 
gression of each of the variables on the factors. It yields 
factors which provide an adequate fit to the data, while 
maintaining all the essential information of the original set 
of variables. 

B. THE FACTOR ANALYSIS MODEL 

It is the object of factor analysis to represent a var- 
iable in terms of several underlying factors, or hypo- 

thetical constructs. Several types of factors may be dis- 
tinguished : 

1 . Common Factors 

a. General factor: present in all variables. 

b. Group factor: present in more than one, but not 

all, variables. 

2. Unique Factors: present in only a single variable. 

Common factors account for the intercorrelations among the 
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variables, while each unique factor represents that portion 
of a variable not attributable to its correlations with 
other variables of the set. 

The simplest mathematical model for describing one var- 
iable in terms of several others is a linear one, and that 
is the form of representation used in factor analysis models. 
Using the notation F, , F„, F 0 , ••• , F for m common factors, 

the complete linear expression for any variable may be 

written in the form 



( 3 - 1 ) 



V. = 
x 



a.,F. + a . ~F„ + a , 
ll 1 i2 2 i3 



- F 3 H ' 



■fa. F 
im m 



where i = 1, 2, ••• , n and a. . is the coefficient of the 

lj 

factor of the i^* 1 variable. There are, of course, n 
equations of this form-one for each of the n variables. 

Some models also include a term a.U. which denotes the 

l l 

unique aspect of any variable — i.e., that portion of its var- 
iance which is not attributable to any common factor. Since 
factor analysis in general, and this paper in particular, is 
concerned primarily with the common factors, the unique term 
will not be included in the model used herein. 



C. FACTOR LOADING AND COMMUNAL I T Y 

The coefficients a^j in equation (3-1) , also called 
factor loadings, can be determined through an analysis of 
the correlations among the n variables. All xn factors are 
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required to reproduce the correlation among the original n 
variables, and each factor, through its loading, is selected 
to make maximum contribution to the sum of the variances of 
the original variables. The first such factor selected makes 
the greatest single contribution; the second makes a maximum 
contribution to the remaining variance, and so on until a 
satisfactory portion (usually less than 100%) of the total 
original variance has been accounted for. Thus, depending 
on the amount of variance which will give a satisfactory and 
acceptable solution, only a small number (less than n) of 
factors will be needed to reproduce the original data. 

For any particular variable, the amount of its total 
variance accounted for by the common factors is called its 
communality. Quantitatively, the communality of a variable 
is given by the sum of the squares of the common-factor 
coefficients, viz. 



(3-2) 






+ a . _ + 
i3 



+ 



a 



2 

in 



2 tli. 

where h^ is the communality of the i variable and 

the a^j are its factor coefficients. 

The residual variance (one minus the communality) is 

the extent to which the variable is unique. It should be 

noted that although the communality can be increased by 

simply increasing the number of common factors extracted 

from the set of variables, this is not, in general, desirable. 
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Parsimonious description of the data requires that the num- 
ber of factors be kept to a minimum. 

Factor analysis techniques require communality est- 
imates as inputs. Successive iteration then leads to the 
final correct communality values. Making the original est- 
imate, however, can sometimes pose a difficult problem. 

There are three principal and commonly used estimating tech- 
niques. They are: 

1. Set the original communality estimate equal to one 
for all variables — i.e., assume that all of the variance of 
the variables will be accounted for by the factors selected. 

2. Use the squared multiple correlations as the commu- 
nality estimates. 

3. Use the maximum row values of the correlation matrix 
as the communality estimate. 

These three techniques are discussed in detail by Harmon 
(4) and others and each has considerable merit in a variety 
of circumstances. The first technique listed above was used 
for this study, not because of any intrinsic superiority, 
but simply because of the author's subjective judgment. 

Having determined the communalities , it is then possible 
to calculate the factor coefficients, or loadings. The most 
frequently used technique (principal-component) begins by 
choosing a set of factors in decreasing order of their con- 
tribution to the total communality. The analysis is begun 
by extracting a factor whose contribution to the commu- 

nalities of the variables is as great as possible. Then the 
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first-factor residual correlations are obtained. A second 

factor F 2 with a maximum contribution to the residual 

communality is next found. This process is continued until 

the total communality has been analyzed. 

The first-factor coefficients a.. are selected to max- 

31 

imize the sum of the contributions of that factor to the total 
communality. For the first factor (F^) , this sum is given by 

(3-3) C n = a?, + a?, + a 2 + • • • + a 2 .. . 

1 11 21 31 nl 

The coefficients a^ in equation (3-3) must be chosen so 
as to maximize under the constraint (for m factors) 



(3-4) 



r ik 



a . a, 
ip kp 



(i ,k = 1, 2 , 3 , 



n) 



P=1 



where r^ = r^ and r^ is the communality of variable 

2 

V. (i.e., r.. = h.). The constraint condition (3-4) says 

i n i J 

that the reproduced correlations are to be replaced by the 
observed correlations, implying the assumption of no unique 
variance (i.e., zero residual error). Recall that it was 
earlier stated that the unique factor would not be included 
in this model. 

Maximization of this function (3-3) of n variables, 
constrained by -ln(n+l) conditions (3-4), is greatly facili- 
tated by the method of Lagrange multipliers, which may be 



applied as follows: define the Lagrangian function (L) such 

that 



n 



n 



m 



(3-5) 2L = C, - 



1, ik r ik = c i - 



i,k=l 



I E 

i ,k=l p=l 



y . , a . a. 
lk ip kp 



where the y^ ( = y^) are the Lagrange multipliers. Then 
set the partial derivative of L with respect to any one of 
the n variables (a.^ with i = 1, 2, ••• , n) equal to zero: 



(3-6) 



3L 

Sa . , 

ll 



= a 



il 



y ik a kl 



= 0, 



k=l 



Similarly, set the partial derivative of L with respect to 
any of the other coefficients (a^ for p ^ 1) equal to zero: 



(3-7) 



3L 




y ik a kp 



k=l 



0. 



The two sets of equations, (3-6) and (3-7), may be combined 
as follows: 



(3-8) 



3L 
3a . 



IP 



( 6 



lp a il 




v 



ik a kp 



k=l 



0 






1 



where p = 1, 2, ••• , m and the Kronecker Delta, 6 



IP 



if p = 1 and 6^ = 0 if p ^ 1. Multiplying equation 

(3-8) by a^ and summing with respect to i leads to: 



n 



n n 



(3-9) 



'lp / il 
i=l 




y . , a • n a, 
K ik il kp 



= 0 



i=l k=l 



Since, according to equation (3-6), 



kl 



n 



i=l 



V • i a . . 
p ik il 



then, by letting 



n 






i=l 



where X is used for convenience only at this point but will 
be defined more rigorously later, equation (3-9) becomes 

n 

^T a ki a k P = °- 

k=l 

Multiplying by a. and summing with respect to p, equation 



(3-10) 



V X 1 " 
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(3-10) becomes 



(3-11) a il X 1 



n 




k=l 



n 



P=1 



a . a, 

ip kp 



0 . 



Applying the constraining conditions (3-4) to equation (3-11), 
the result is 



n 

(3-12) ^ r ik a kl " X l a il = 0 (i = 1, 2, • • • , n) 

k=l 

2 

which is a system of n equations. Recalling that r_^= 
and dropping the subscript of A^ for convenience, this sys- 
tem of n equations may be written as follows : 



2 

(h^ - A) a i;L + 



(3-13) < 



r 21 a ll 



r l a i i 

nl 11 



+ (h! 



r 12 a 21 
; - A ) a 



21 



+ ... -f 

+ • • • + 



r 1 a 
In nl 



r 0 a , 
2n nl 



r n2 a 21 



+ (h n - X)a nl 



0 

0 

0 



The existence of a nontrivial solution to this system of 
equations requires that the determinant of the coefficients 
vanish, as follows: 







A 



(3-14) 








‘nl 



n2 








0 
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order 



th 

Expansion of this determinant results in an n 
polynomial in A, known as the characteristic equation (of 
the system). The polynomial has a family of solutions, all 
of which are proportional to one particular solution, with 
the factor of proportionality given by 



n 




i=l 



Recall, however, from equation (3-3), that this is precisely 
the quantity to be maximized. It follows, therefore, that 
the maximizing solution to is the largest root of the 

characteristic equation. To find the coefficients of the 
first factor (F^) which will account for the maximum amount 
of communality , the value of A^ is now substituted into the 
set of equations (3-13) and any solution a gg» a 21' **’ ' a nl 

is obtained. To satisfy the conditions of equation (3-3) , 
these values are divided by the square root of the sum of 
their squares and multiplied by YT. The resulting quan- 
tities are the desired coefficients of F^ in the factor 
pattern (3-1) : 



(3-15) 



a il 



a.,VT 

ll 



V® 



2 2 
11 + a 21 + 



+ a 



nl 



where i=l, 2, •••,n. In the literature of mathematics, 

the roots (A's) of the characteristic equation are called 
eigenvalues, while the solution to the set of equations (3-14) 
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corresponding to each eigenvalue leads to a vector (a set of 
a's) which is called an eigenvector. 

The problem now remains to find the coefficients of the 
remaining factors , accounting for a maximum amount of the 
residual communality. The residual correlation after the 
first factor has been extracted is given by 



(3-16) 



ik 



r . . - a . , a. . 

ik ll kl 



and the quantity to be maximized is 



(3-17) 



2 2 
a 12 + a 22 + 



a 



2 

n2 



subject to the constraint condition of (3-16). Iteration of 
the method of Lagrange multipliers yields the second 

largest eigenvalue, as the maximizing value of C The 
second-factor coefficients are then determined as above. 
Successive iteration of this procedure will eventually pro- 
duce the complete set of factor coefficients, or loadings. 



D. FACTOR ROTATION 

Once a set of factor loadings has been calculated, the 
next step in the analysis is to interpret the factors in a 
way that will give a meaningful summary of the observed data. 
Since the factor loadings are produced in an arbitrary frame 
of reference, the problem is to choose a reference frame for 
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the factor loading points which will give the most meaning- 
ful and/or most useful interpretation. To this end, the arbi- 
trary frame of reference may be rotated to one more suited to 
interpretation. There are numerous rotational techniques and 
criteria to select from. Thurstone (10), for example, has 
specified his criteria for simple structure which ideally 
would result in a relatively unique configuration of factor 
loadings and a relatively standard location for the reference 
frame. As pointed out by Morrison (8), however, the problem 
with these criteria is that they rarely exist when using real, 
data. For simplicity, rotational techniques can be grouped 
into two broad classes: orthogonal and oblique. Although 

orthogonal rotation is not suitable for all data, it has at 
least one distinct advantage. Since the resulting factors 
are orthogonal, they are uncorrelated (independent), which 
greatly facilitates interpretation. It should also be pointed 
out that the varimax orthogonal rotation technique was devel- 
oped by Kaiser (6) in 1958 to allow actual data to meet 
Thurstone 's simple structure criteria as closely as possible. 
This is the rotational technique which was used in this study. 

E . FACTOR SCORES 

From a purely theoretical point of view, the common 
factors have a more fundamental importance than the observed 
variables themselves and it is therefore necessary to relate 
the observations to the common factors. This is done by 
means of factor scores, which are a means of expressing 



quantitatively the information contained in a factor for a 
specific case or individual. Through the factor scores, the 
difference between two cases can be expressed in terms of the 
reproduced correlations of the original data. 

The computation of factor scores is based on the factor 
loadings previously determined. When using ones on the main 
diagonal of the correlation matrix, as in this study, the 
principal-factor solution may be expressed in matrix notation 
as follows: 



(3-18) V = AF 



where 

V = n X 1 column vector of variables, 

A = n X n matrix of factor loadings, and 

F = n X 1 column vector of factor scores. 



The factor scores are then given by: 



(3-19) 



F = 



A 1 V. 



F. FACTOR INTERPRETATION 

After the factor loadings and factor scores have been 
determined, there remains only the task of interpretation. 

A complete solution requires an identification of the nature 
and content of the hypothetical factors. Fruchter (3) in- 
dicates that this is commonly done by inferring what the var- 
iables with high loadings on a factor have in common that is 
present to a lesser degree in variables with moderate or low 
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loadings and absent from variables with zero (or near zero) 
loadings. He further defines an arbitrary classification 
scheme for factor loadings, as follows: 

1. Insignificant: factor loading below 0.2 

2. Low: factor loading of 0.2 to 0.3 

3. Moderate: factor loading of 0.3 to 0.5 

4. High: factor loading of 0.5 to 0.7 

5. Very high: factor loading above 0.7. 

Although Fruchter 1 s classification scheme is admittedly arbi- 
trary, this phase of the analysis is necessarily less objec- 
tive and more subject to the desires and experience of the 
analyst than that which preceded. Even so, there is quan- 
titative justification for at least a portion of his classi- 
fication scheme. Recall that in linear regression, the 
square of the correlation coefficient indicates the propor- 
tion of the total variance explained by the regression. Thus, 
a factor loading of 0.7, which separates the "high" and "very 
high" classifications, corresponds to a level of correlation 
between the variable and factor in which nearly one half of 
the observed variance has been accounted for. 

A factor loading of 0.7 will therefore be adopted in 
this study as being indicative of a "significant" correlation 
between variable and factor. From there, an attempt will be 
made to assign convenient, understandable, and unambiguous 
names to the factors , based on an observation of those var- 
iables with significant loadings. 
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IV . THE DATA 



The data for this study consisted of the fitness report 
summaries from 450 randomly selected Master Brief Sheets 
(form NAVMC HQ 466) for Marine Corps Officers in the grades 
Second Lieutenant through Colonel. The data was furnished by 
Headquarters, U. S. Marine Corps (Code MMPA) upon my official 
written request. Each Master Brief Sheet represents a com- 
plete fitness report record for a particular individual since 
mid-1972, when the Performance Evaluation System was automated. 
It contains all of the evaluations for the 22 dimensions pre- 
viously discussed. The personal information from Section A 
of the fitness report (see Appendix A) had been deleted from 
each Brief Sheet to insure the confidentiality of each indi- 
vidual's record. 

Of the original 450 Master Brief Sheets, 46 were found 
to contain insufficient information to be useful in this 
study. Additionally, four of the 22 dimensions were dominated 
by "Not Observed" marks and were therefore eliminated from 
analysis. The eliminated dimensions, with percentage of "Not 
Observed" marks, were as follows: 



1 . 


Additional Duties 


- 89% 


2. 


Tactical Handling 


- 87% 


3. 


Endurance 


- 62% 


4. 


Presence of Mind 


- 93% 
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Since each Brief Sheet represents a separate observation of 
the variables (dimensions of performance) , the data for the 
analysis consisted of 404 observations of 18 variables. 

Since the factor analysis technique is essentially 
mathematical in nature, it was necessary to convert the sub- 
jective non-numeric scale (excellent, above average, etc.) 
used by the reporting officers to a numeric scale suitable 
for the analytic technique. To do this it was first neces- 
sary to make an assumption about the distribution of the 
attributes which the fitness report is designed to measure. 
The Normal, or Gaussian, Distribution was assumed for this 
study, as is common in such cases. The argument for use of 
the Normal Distribution is strengthened by the fact that 
arithmetic means of variable markings were eventually used 
in the analysis. By the Central Limit Theorem, these means 
tend to be normally distributed, regardless of the actual 
underlying distribution (9). 

In a random sample of 100 fitness reports (from the 404 
Master Brief Sheets), the frequency, relative frequency, 
cumulative relative frequency, and standard normal deviate 
(z-value) for each mark, or scale value (excellent, etc.) 
were determined. The results are shown in Table I. 

To calculate the mean, or expected value, of each of 
these marks (denoted by X) , let f (X) represent the dis- 
tribution function of the marks within the interval , 

where z^ and z^ are the minimum and maximum standard 
normal deviates, respectively, of the mark. The expected 
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Table I. Distribution of Marks 
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value is then given by: 



(4-1) 



X 




X f(X) dx 




f(X) dx 



Since the normal distribution has been assumed, f (X) is 
given by: 



(4-2) 



1 - x 2 /2 

"V^T e 



(-00 < x < °°) . 



After substitution and integration, the desired scale values 
are given by: 



- 0 . 5z 2 - 0 . 5z 2 ' 

e - e 

F(z 2 ) - F(z 1 ) 

where the numerator can be determined by direct substitution 
of the z-values and the denominator can be determined from 
any table of areas under the normal curve. 

As an illustrative example, let X^ n denote the value 
of an unsatisfactory mark. Then 

- 0 . 5 (-3 . 22 ) 2 - 0 . 5 (-“) 2 ‘ 

e - e 

un 

F (-3.22) - F(-«>) 
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which, after substitution and reduction becomes 



X 



un 



- (0.3989) (0.0056 - 0) 

(0.0006 - 0) 

- 3.7264. 



Similarly, X^ a f the value of a Below Average mark is given 
by: 



X 



ba 




• - 0 . 5 ( 2 . 9 1 ) 2 - 0 . 5 (-3 . 22 ) 2 

e - e 



F (-2.91) - F (-3 . 22 ) 



- (0.3989) (0 .0 145 - 0.0056) 

(0.0018 - 0.0006) 



= - 2.9552. 



The results of these calculations were then subjected 
to a linear transformation to eliminate negative signs and 
decimal points. The transformation was of the form 

(4-4) T = 1000 ( X + 4 ) 

where X is the scale value obtained from equation (4-3) and 
T is the more convenient transformed value. The results of 
these calculations and transformations are shown in Table II. 

The transformed values (T) were then substituted for 
their corresponding markings on each of the fitness reports 
and a statistical average for each of the 18 variables was 
obtained for each of the 404 individuals comprising the data 
base. The average values for each of the individuals, rather 
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Table II. The Numeric Marking Scale 



MARKS 


ORIGINAL 

VALUE 

(X) 


TRANSFORMED 

VALUE 

(T) 


Unsatisfactory 


- 3.7264 


0273 


Below Average 


- 2.9552 


1045 


Average 


- 2.6556 


1344 


Above Average 


- 1.8585 


2142 


Excellent 


- 0.5876 


3412 


Outstanding 


C . 8387 


4839 
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than the value of each mark on each of the available fitness 
reports, was used in the factor analysis to minimize the 
effect of "random error" caused by improper marking and rater 
bias. The result is the 404 by 18 matrix of markings con- 
tained in Appendix B. 

In addition to quantifying the individual markings , it 
was necessary to assign numbers to the variables to be 
analyzed, a somewhat more simple task. The numbering scheme 
is shown in Table III. 
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Table III. Variables to be Analyzed 



VARIABLE 

NUMBER 


BEHAVIORAL 

DIMENSION 


1 


Regular Duties 


2 


Administrative Duties 


3 


Handling Officers 


4 


Handling Enlisted 


5 


Training Personnel 


6 


Personal Appearance 


7 


Military Presence 


8 


Attention to Duty 


9 


Cooperation 


10 


Initiative 


11 


Judgment 


12 


Force 


13 


Leadership 


14 


Loyalty 


15 


Personal Relations 


16 


Economy in Management 


17 


Growth Potential 


18 


General Value to the Service 
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V. THE ANALYSIS 



Analysis of the data from the 404 observations of the 
18 variables was accomplished in two major steps. The first 
step utilized the complete data set, treating the sample 
population as an integral whole. In the second step, the 
data was separated into subsets, one subset for each rank 
(Second Lieutenant through Colonel) and one subset each for 
Company Grade Officers (Second Lieutenant, First Lieutenant, 
and Captain) and Field Grade Officers (Major, Lieutenant 
Colonel, and Colonel). The second step constituted an effort 
to determine whether or not significant observable differ- 
ences in factor structure exist between the various subgroups 
In both steps, the data was analyzed using the Biomedical 
Factor Analysis program BMD08M. The type of rotation and the 
number of factors extracted were varied in an attempt to 

i 

account for the variance of a maximum number of variables. 
After a number of trial runs of the program, it was deter- 
mined that varimax orthogonal rotation for three factors pro- 
duced very high factor loadings (greater than 0.7) on 12 of 
the 18 variables and accounted for 73.5% of their total var- 
iance. The next best combination of number of factors and 
rotation technique produced very high factor loadings on only 
10 variables, without an increase in the proportion of total 
variance accounted for. The three-factor varimax orthogonal 



38 



rotation procedure was therefore selected for use in the 
remainder of the analysis. 



A. ANALYSIS OF THE COMPLETE DATA SET 

Since factor analysis is essentially an analysis of the 
correlations between variables, a logical starting point is 
an examination of the correlation matrix, reproduced in Table 
IV. This table shows the correlations between all possible 
pairs of variables. It shows a wide range of correlations, 
from 0.31 to 0.84, and indicates that there is, in fact, a 
high correlation between some of the variables. It does 
little, however, to illuminate a pattern which might reveal 
the underlying factors. The most essential and useful infor- 
mation is contained in the matrix of factor loadings , shown 
in Table V. 

Using the criterion, previously established, of very 
high factor loadings being significant. Table V shows that 
the following variables have significant loadings on the 
first factor: 

1. Regular Duties (variable 1) 

2. Training Personnel (variable 5) 

3. Initiative (variable 10) 

4. Judgment (variable 11) 

5. Force (variable 12) 

6. Leadership (variable 13) 

7. Economy in Management (variable 16) 

This means that these seven variables are all closely related 
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Table IV. Correlation Matrix 
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Table V. Factor Loading Matrix 







FACTOR 




VARIABLE 


1 


2 


3 


1 


0.7435 


0.2861 


0.3664 


2 


0.6749 


0.1574 


0.4105 


3 


0.5836 


0.3968 


0.3330 


4 


0.5975 


0.3330 


0.3543 


5 


0.7267 


0.2429 


0.1574 


6 


0.1319 


0.9116 


0.1487 


7 


0.4413 


0.7385 


0.3037 


8 


0.6662 


0.2062 


0.5195 


9 


0.3395 


0.2267 


0.8000 


10 


0.7970 


0.2003 


0.3170 


11 


0.7270 


0.2691 


0.4168 


12 


0.8046 


0.2404 


0.1459 


13 


0.7196 


0.4504 


0.3269 


14 


0.2664 


0.1244 


0.7469 


15 


0.2992 


0.3126 


0.7425 


16 


0.7209 


0.1189 


0.3571 


17 


0.5344 


0.6094 


0.2694 


18 


0.6878 


0.4754 


0 . 4018 
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to a single underlying factor and could be more efficiently 
represented by a single dimension — i.e., by a single question 
on the fitness report. Assigning an acceptable name to the 
factor requires both insight and judgment. An examination of 
the component variables reveals that they are principally 
task or goal oriented. They all measure some aspect of how 
an individual performs on the job. Since the sample popula- 
tion consists entirely of officers, it can be assumed that a 
typical job for a member of the sample is more than routinely 
mechanical. It undoubtedly requires leadership capability, 
coupled with force, initiative, and judgment. Economy in 
Management can be regarded as a measure of effectiveness of 
job performance and since nearly all Marine Officers have 
subordinates in their charge, the military concept of leader- 
ship implies a training function in nearly all jobs. Thus, 
all the variables with very high loadings on the first factor 
can be regarded as elements of task orientation or accom- 
plishment . 

Additional insight into the nature of the first factor 
can be gained from an examination of those variables which, 
although not having "very high" factor loadings, nevertheless 
had higher loadings on this factor than on either of the 
other two. They are: 

1. Administrative Duties (variable 2) 

2. Handling Officers (variable 3) 

3. Handling Enlisted (variable 4) 

4. Attention to Duty (variable 8) 

5. General Value to the Service (variable 18) 
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Given the assumption that every Marine Officer inter- 
acts with both officer and enlisted subordinates in the per- 
formance of his duties, these variables are also task or goal 
oriented, with the possible exception of variable 18. De- 
ferring discussion of variable 18 for the moment, it seems 
safe to assign to the first factor a name such as "Task 
Orientation and Effectiveness". 

Turning now to the second factor, the variables with 
very high factor loadings are: 

1. Personal Appearance (variable 6) 

2. Military Presence (variable 7). 

These variables relate to how an individual appears and how 
he behaves, both of which are external manifestations of an 
internal quality which may be called pride or self-image. 

It is interesting to note that the highest factor loadings 
of all the cases occurred here, for Personal Appearance on 
factor two. Apparently, then, the external manifestation is 
as important as the underlying self-image. In order to in- 
clude both aspects, and to eliminate any confusion with cur- 
rently used names, the second factor will be called "Self- 
image and Bearing". 

The third and final factor had three variables with very 
high loadings. They are: 

1. Cooperation (variable 9) 

2. Loyalty (variable 14) 

3. Personal Relations (variable 15) 

Just as the first factor was clearly task-oriented, the 
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third is clearly people-oriented. It measures interpersonal 
behavior, or interaction. In one sense it also measures team 
spirit, since loyalty is presumably on a professional rather 
than personal level and applies to either the organization 
or its goals. The cooperation and personal relations, then, 
are with other members of the team. These variables measure 
more than just "spirit", however. They also include a measure 
of how effectively the team spirit is established and main- 
tained. The third factor was therefore called "Team Orien- 
tation and Effectiveness". 

The three factors measured by a Marine Corps fitness 
report, then, relate principally to the task, the self, and 
the team. The three factors, using the names assigned above, 
are : 

1. Task Orientation and Effectiveness 

2. Self-image and Bearing 

3. Team Orientation and Effectiveness 

Two of these three factors correspond very closely to the 
results of a factor analysis conducted by Fleishman, Harris, 
and Burtt at Ohio State University (2) . Their research was 
an attempt to isolate and define certain basic factors relat- 
ing to leadership and supervision in industry. They developed 
and administered a leadership description questionnaire which 
was then factor-analyzed. Their factor analysis produced two 
common factors, which they called "Initiating Structure" and 
"Interpersonal Effectiveness". The performance variables 
which factored into components of "Initiating Structure" 
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included those relating to patterns of task accomplishment. 
Explicit in this factor were the behavioral dimensions of 
leadership and aggressiveness (force) . Their study did not 
identify a factor comparable to "Self-image and Bearing", 
however. Such factors would seem to be limited to organiza- 
tions for which external image or appearance is important--as 
in the military services or certain large corporations, but 
not in industry (the environment for the Ohio State study) . 

As stated earlier, the three common factors of this 
study collectively accounted for 73.5% of the total variance 
of all the variables. The equivalent information for any 
specific variable is contained in its communality, which is 
the proportion of its variance accounted for by the common 
factors. The communality of each of the variables is shown 
in Table VI. 

At this point it is possible to speculate about the 
significance of variable 18, General Value to the Service. 

If this variable actually measures what its terms and defi- 
nition indicate it should measure, it could indicate the 
relative importance of the three factors to the Marine Corps. 
For example, its highest loading is on the first factor. 

This could, and probably does, indicate that Task Orientation 
and Effectiveness is the most important single dimension of 
Marine Corps performance, followed, though not too closely, 
by the second and third factors in that order. This is not 
a particularly surprising result, since the military community 
commonly stresses the primary importance of the mission (task).. 



Table VI. Conununalities 



VARIABLE COMMUNALITY 



1 


0.7689 


2 


0.6489 


3 


0.6089 


4 


0.5934 


5 


0.6119 


6 


0.8706 


7 


0.8324 


8 


0.7562 


9 


0.8067 


10 


0.7757 


11 


0.7747 


12 


0.7264 


13 


0.8274 


14 


0.6442 


15 


0.7385 


16 


0.6614 


17 


0.7295 


18 


0.8605 
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As a final step in the analysis it was necessary to 
compare the relative scores of the 404 individuals on the 
three factors. This is the information that would be con- 
tained in a fitness report if the three factors, rather than 
the 18 variables, were used. The table of factor scores in 
Appendix C, then, represents the fitness report data for the 
404 individuals in reduced form. A comparison of Appendices 
B and C reveals that those individuals with low scores on 
the first factor received low markings on one or more of the 
variables of which that factor is composed. Similarly, high . 
factor scores equate to high markings. 

As an illustrative example, individual (case) number 367 
has a factor score of -5.05024 on the second factor. Appen- 
dix B reveals that this individual had markings of 1382 and 
1776 on the Personal Appearance and Military Presence var- 
iables, respectively. On the actual fitness reports for this 
individual, these numbers correspond to the following markings 
(for six reports): 

1. Personal Appearance: two Above Average, two Average, 

one Below Average and one Unsatisfactory. 

2. Military Presence: four Above Average and two Below 

Average . 

This is admittedly an extreme example, but it illustrates 
very clearly the correspondence between factor scores and 
actual markings. A thorough examination of Appendices B and 
C reveals that the correspondence between factor scores and 
fitness report markings holds throughout the set of data and 
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indicates that the three factors do, indeed, contain most of 
the essential information of the original 18 variables. 



B. ANALYSIS OF SUBSETS OF THE DATA 

During this phase of the analysis, the original data 
was separated into the following eight subsets : one for each 

of the six ranks, one for Company Grade Officers, and one for 
Field Grade Officers. The subsets were then analyzed by the 
same procedures that were used for the complete set. Each 
subset factored into three factors, as before. The factor 
loadings, communalities , and factor scores changed, but the 
composition of the factors remained relatively constant 
throughout. In no case did the proportion of total variance 
accounted for by the three factors fall below 70%. In short, 
there seemed to be no significant difference in factor struc- 
ture between any of the groups (including the complete data 
set) studied. In view of this finding, it seemed neither 
necessary nor worthwhile to reproduce the tables for each of 
the subsets of data. 

One significant difference between the groups was, how- 
ever, revealed during this phase of the analysis. That dif- 
ference concerns the means of the markings on the various 
variables and is clearly visible in Table VII. The values 
in the table are the arithmetic means of the values in Appen- 
dix B for the groups indicated. The last column of Table VII, 
titled "All", is the mean of all values of the specified var- 
iable. The last row, titled "Group", shows the means for 
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Table VII. Means of the Marks 
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each of the indicated groups for all variables. Two facts 
stand out from this table: 

1. The mean marking for Second Lieutenant is higher 
than the corresponding marking for First Lieutenant in every 
case. 

2. The mean markings increase by rank from First Lieu- 
tenant in all but three cases, and the magnitude of the three 
reversals is very small. 

The trend indicated by paragraph (2) above is largely 
predictable, since it is assumed that only the "most quali- 
fied" individuals are promoted. The meaning of the reversal 
of this trend by First/Second Lieutenants is less clear, how- 
ever. One possible explanation is that Second Lieutenants, 
being largely young and inexperienced, are not judged by the 
same standard as others — i.e., not as much is expected of 
them. 

One other point from this table is worthy of mention. 

The mean marking for variable 14, Loyalty, is consistently 
higher than all others for each group and for the sample as 
a whole. This indicates either that all Marine Officers are 
very loyal or that reporting officers are ill-disposed to 
indicate otherwise. Considering the meaning which might be 
attached to a low marking on this variable (e.g., disloyalty) , 
the latter is undoubtedly the case. 

Table VIII shows the standard deviations of the markings 
by variable and by sub-group. The last column gives the 
standard deviation of all marks for the given variable, while 



Table VIII. Standard Deviations of the Marks 
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Group 690 617 596 580 541 506 624 567 617 



the last row gives the standard deviation for each of the 
sub-groups and is calculated as follows (11) : 

S T " V V + S M 

where, for each of the sub-groups, Mg 2 is the mean of the 

2 

variances of the variables and S„ is the variance of their 

M 

means . 

The main point to be learned from Table VIII is that 
the total dispersion of marks decreases as rank increases, 
although there is no clear trend for any specific variable. 
This means that the markings for higher ranks are not only 
better (higher) in the average than for lower ranks (with 
the exception pointed out above) , but also that they are more 
consistent. It would not be true, however, to say that the 
variance (square of the standard deviation) decreases to the 
point where there is an insignificant difference between 
the marks for the higher ranks. Since the marks on the 
fitness reports are used for promotion and retention pur- 
poses, variance is essential for the proper execution of 
such decisions. It appears from the data that even though 
the variance decreases, it remains sufficient, even in the 
higher ranks, to satisfy the needs of the system by providing 
a basis for selection. 
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VI. 



CONCLUSION 



If personnel performance is important to an organiza- 
tion, it follows that performance evaluation is also important 
It is not sufficient, however, simply to have a functioning 
system for the evaluation of performance. It is essential 
that the system be both effective and efficient. The system 
currently employed by the Marine Corps is apparently effective 
in the sense that it fulfills its objectives to the satisfac- 
tion of its users. The question raised and examined in this 
study concerns not the effectiveness, but the efficiency of 
the system. Does the Marine Corps Fitness Report provide the 
necessary information in the most efficient way? Based on 
the analytic results presented earlier, it apparently does not 
The 18 behavioral dimensions examined in this study 
undoubtedly contain information which is vital to the needs 
of the Marine Corps, but nearly three-quarters of this in- 
formation could be acquired by asking only three questions, 
rather than 18, about the individual being evaluated. As 
is frequently the case, there is a necessary trade-off be- 
tween completeness and efficiency. More information can be 
acquired by asking 18 questions than by asking three. And 
still more could be acquired from 20, 30, or 50 questions. 

But the larger reports are undoubtedly less efficient, since 
there is a limit to the amount of useful and relevant infor- 
mation that can be acquired. 
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The question to be answered, then, not by this paper 
but by the appropriate policy-makers, is: How much infor- 

mation is enough? If the amount of information contained 
in the three factors proposed by this study is not sufficient, 
then additional factors should be introduced. The additional 
factors should correspond to those variables with low factor 
loadings on the three common factors, since they are the 
ones least represented by the common factors. 

The ultimate decision in this matter, however, depends 
on the needs and objectives of the system. The three factors 
hypothesized by this study appear adequate to satisfy those 
objectives, as they have been previously defined. The three 
factors can provide an evaluation of diities performed; they 
can provide a comprehensive portrayal of the professional 
qualifications, personal traits and characteristics, and 
potential of the individual; and they can provide a basis 
for determining duty assignments and promotional qualifications. 
And they can do all this faster and more easily than is 
possible in the existing system. 
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APPENDIX A. THE MARINE CORPS FITNESS REPORT 
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Sections C and 
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APPENDIX B. MATRIX OF MARKINGS 
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